THE SORTING INDEX 

T. KYLE PETERSEN 



f^ , Abstract. We consider a bivariate polynomial that generalizes both the length and re- 

O^ ' flection length generating functions in a finite Coxeter group. In seeking a combinatorial 

description of the coefficients, we are led to the study of a new Mahonian statistic, which 
we call the sorting index. The sorting index of a permutation and its type B and type D 
analogues have natural combinatorial descriptions which we describe in detail. 
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1. Introduction 



Q , The following is a well-known and elegant formula for the distribution of inversions over 

rj I permutations of n: 

^: (1) Y,q""^'"^ = {^ + q){^ + <i + <f)---{^ + <i + --- + q''-')- 

(Knuth pn 5.1.1] attributes the formula to Rodrigues.) MacMahon [12] showed that an- 
other statistic, now called the major index, has the same distribution as inversion number. 
^ \ In his honor, any permutation statistic with this distribution is referred to as a Mahonian 

[^^ ■ statistic. Similarly, there is a simple formula for the distribution of the number of cycles in a 

O . permutation (see, e.g., [HI Prop. 1.3.4]): 

(2) Y^ t^y^"-) = t(t + l)(t + 2) ■ ■ ■ (t + n - 1). 

O , 

O ! The coefficients of this polynomial are well-known as the (unsigned) Stirling numbers of the 

first kind. 

Both Equations ([T]) and ([2]) can be given simple combinatorial proofs, and it is interesting 

^ , that they both factor with the same number of terms. This suggests a natural bivariate 

^ \ polynomial: 

Sn{q, t):=t{t + q){t + q + q^)---{t + q + --- + g""^), 

which clearly generalizes both polynomials above. This polynomial does not give the joint 
distribution of inversion number and cycle number. However, we find statistics sor(w) 
and rl-min(ti;) such that Sn{q,t) is the generating function for both the pair of statistics 
(inv,rl-min) and the pair (sor, eye). In particular, sor(w) is Mahonian, and rl-min(w) has a 
"Stirling" distribution. While a variation of rl-min(w) appears early in [13], sot{w) seems not 
to have appeared in the literature. Given the variety of distinct Mahonian statistics (see [T], 
[3], [3|, [Z], [8], [131 A008302] and references therein) we find the novelty of sor(w) noteworthy. 
We call sot{w) the sorting index of w. 

In Section [2] we make precise the story told above, and we follow that discussion with very 
similar results for signed permutations in Section[3l In the context of reflection groups, inv(w) 
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corresponds to length and n — cyc(w) corresponds to reflection length. Sections |4] and [5] discuss 
how the ideas of Sections |2] and E] might be generahzed to other Coxeter groups. Indeed, the 
discovery of the sorting index followed from the investigation of a common refinement of the 
length and reflection length generating functions in an arbitrary finite reflection group. The 
polynomial Sniq,t) given above is the type A version. See Section [51 Another avenue for 
generalization could be from permutations to words (with repeated letters) as in [T2| Section 
III] , though we do not pursue this line of inquiry here. In Section |6] we remark upon recent 
work of others related to the type A version of the sorting index. 

Throughout the paper, we will let [n\q = ^j^ = 1 + q + ■ ■ ■ + g"~^. We refer the reader 
to [21 Sections 8.1 and 8.2] for facts about the combinatorics of Coxeter groups (in particular 
combinatorial descriptions for inversions of types i?„ and D„) that we use here without proof. 

2. Permutations (type A) 

One generating set for Sn is the set of transpositions: 

T = {{ij):l<i<j<n}; 

another is the set of adjacent transpositions: 

S = {{ii + I) : 1 < i < n - 1} c T. 

We will usually write elements w E Sn a.s words on the set {l,2,...,n} or as products 
of transpositions in S or T. We will abbreviate transpositions by tij = (ij) and adjacent 
transpositions hj Si = {ii + 1). 

In what follows, we will give two different factorizations of the diagonal sum, i.e., Ylwes ^' 
in the group algebra Z[S'„]. We then examine how two pairs of statistics, (inv,rl-min) and 
(sor, eye), behave under the factorizations. Because both factorizations lead to the expression 

n 

Sn{q,t):=l[{t+[^q-l), 
j=i 
we will conclude that the joint distribution of the pairs of the statistics are the same. We 
refer inv and sor as Mahonian statistics, rl-min and eye as Stirling statistics. 

2.1. Mahonian statistics. Given a permutation w G Sn, the minimal number of adjacent 
transpositions needed to express w is called its length, i{w). An inversion of w is a pair i < j 
such that Wi > Wj. Let inv(w) denote the number of inversions of w. It is well-known that 
the number of inversions in a permutation is equal to its length: inv(w) = i{w). For example, 
£(312) = 2 since 312 = S2S1, but also 312 has two inversions since 3 > 1 and 3 > 2. Any 
statistic with the same distribution as inversion number is called Mahonian. 

We now define the sorting index of a permutation. Given a permutation w E Sn, there is 
a unique expression 

as a product of transpositions with ji < ■ ■ ■ < jk. The sorting index, sor(w), is given by 

k 

sor(w) = y^Js -is- 

s=l 

The transpositions in this factorization are precisely the transpositions used in the "straight 
selection sort" algorithm, which we now describe. Using a transposition we first move the 
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Table 1. Examples of inversion number versus sorting index, and cyc{w) ver- 
sus rl-Tumiw). 



largest number that is out of order to the end, then we move the next largest number to its 
proper place, and so on. (See Knuth [TT|, 5.2.3].) For example, ii w = 2431756, we have 



and so 



w 



2431756 ^ 2431657 ^ 2431567 ^ 2134567 ^ 1234567, 



ti2t24t56t57, sor(w;) = (2 - 1) + (4 - 2) + (6 - 5) + (7 - 5) = 6. 



The sorting index, then, is the sum of the distances that all the letters had to move during 
the sorting. We will show that this statistic has the same distribution as inversion number. 

2.2. Stirling statistics. For w G S'„, the reflection length oiw, i'{w), is the minimal number 
of reflections (in T) needed to express w. Let cyc(w) denote the number of cycles of w. 
Reflection length and cycle number are related by cyc(w) = n — i'{w). 
For w E Sn define the following statistic: 



rl-mmiw) 



n 



\{i : Wi> Wj for some j > i}\ = \{i : Wi < Wj for all i < j}|, 

that is, rl-min(w) is the number of letters of w that are right-to-left minima. For example, 
w = 2413756 has rl-min(i(7) = 4. We will see that rl-min has the same distribution as eye. 

2.3. Factorizations of the diagonal sum. One of the simplest ways to generate all per- 
mutations of n is defined recursively. For each permutation of n — 1, simply insert the letter 
n in all possible positions. We now describe a way to encode this idea algebraically. Define 
elements \l/i of the group algebra of S'„ as: \l/i = 1 + si, \l/2 = 1 + S2 + S2S1 = 1 + S2 ■ \I/i, 
and in general for i > 1, \l/j = 1 + Sj ■ \l/j_i. It should be clear that each term in \l/j is a 
reduced expression in Si^i. The following proposition shows how the product of these terms, 
1 < i < n, produces reduced expressions for all elements of Sn- 



Proposition 1. For n > 2 we have 

^1^2 



^ 



n-l 



w€Sn 



w. 
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Proof. Clearly \l^i = J2weS2 ^- -^^^ induction, suppose \l'i • ■ ■ \1'„_2 = J2weSn-i '^- ^^ ^^^ 
identify the elements of Sn-i with the set 

{w E Sn '■ w{n) = n}. 

(In fact, written as products of the simple transpositions above, they are identical.) Given 
such an element w = wi- ■ ■ Wn-in, the terms in "^n-i dictate the location of n: 

W ■ \E'„_i =W + WSn-l + WSn-lSn--2 H WSn-lSn-2 ■■■Si 

= Wi- ■ ■ Wn-in + Wi--- Wn-2nWn-l H h UWi ■ ■ ■ Wn-l- 

It is clear moreover that w ■ "^n-i = v ■ ^n-i if and only ii w = v. We have 

w&Sn,w{n)=n U^Sn 

as desired. D 

We can now state the following corollary to Proposition [H For t = 1, this is Equation (fTI) . 
Corollary 1. For n >1 we have 

n 

Sn{q,t) = l[{t+[^, - 1) = E g'"^("')f^-"^'"('"). 

This expression for the generating function of (inv, rl-min) can be seen as a special case of 
Theorem 1.2 of [5] (see Remark 2, page 17). 

Proof. We find it convenient to prove an equivalent factorization, namely. 



rs„{q, i/t) = n(i + m, -t)=Yl ^'"^"^^" 



-rl-min(ui) 

Define the linear map ^ : Z[Sn] -^ Z[q,t] given by ipiw) = ginv(t«)^n-ri-min(,«)_ gy ^^^_ 
struction, ipi^^i) = {I + qt + qH + ■ ■ ■ + qH) = (1 + t[i + 1]^ — t). Suppose for induction 
that 

^'(^l ■ ■ ■ ^n-2) = H^^l) ■ ■ ■ V'(^n-2) = J^ ^inv(^)f l-min(«,) _ 

WGSn-l 

It suffices to show that the following holds: 

7/^(^1 ■ ■ ■ ^„_2)^(^„-l) = V^(^l ■ ■ ■ ^„_2^n-l). 

Following the proof of Proposition [H we see that \E'n-i has the effect of positioning n in 
a permutation. If n is placed in the rightmost position it participates in no inversions and 
is a right-to- left minimum. If n is inserted so that there are i > letters to its right, then 
because it is the greatest letter it can never be a right-to-left minimum, and it participates 
in i inversions. Thus it contributes weight qH. For a permutation w = wi- ■ ■ Wn-in, we have: 

1p{w ■ \I'„--l) = 4j{wi ■ ■ ■ Wn^in) + IplWi ■ ■ ■ Wn-2nWn-l) H h ij{nWi ■ ■ ■ Wn-l) 

= tpiw) + qtipiw) H h q'^^Htpiw) 

= tlj{w)il + t[n]g -t)= iP{w)^{^n-i). 
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Thus, 

\w£S„,w(n)=n 
wGSn,w{n)=n 

as desired. D 

We now present a different factorization of the diagonal sum. Intuitively, the procedure it 
describes is: given a permutation of n — 1, put letter n in any position i = 1, . . . ,n — 1, and 
move the letter that was in position i to the end. Let $i = 1 + ti2, $2 = 1 + ^23 + ^13, and 
for j > 2 let $j = 1 + J2i<j tij+i- The following proposition shows that the product of these 
terms produces a minimal length product of reflections for each element of Sn- 

Proposition 2. For n > 2, we have 

$i<l>2- ■■$„-! = ^w. 

uig5„ 

Proof. Obviously the formula holds for n = 2. For induction, suppose $1 ■ ■ ■ $„_2 = Ylwes ^• 
We observe that $„-! is 1 plus the sum of all reflections involving the letter n. Thus, for 

w = Wi- ■ ■ Wn-iTi we have 

W ■ $„_! =W + Wtn-ln + Wtn-2n H h Wtin 

= Wi- ■ ■ Wn-in + Wi ■ ■ ■ nWn-l + Wl ■ ■ ■ nWn-lWn-2 H h nW2 ■ ■ ■ Wn-lWi. 

From these descriptions it is clear that w ■ $„_i = v ■ $ri-i if and only ii w = v, and so we 
have the desired result: 

$1 ■ ■ ■ $„_2'^n-i = Yl ^ ■ "^"-1 = Y^- 

w£Sn,w{n)=n W£Sn 

u 

By looking at the combinatorics of the factorization in Proposition [21 we have the following. 
Corollary 2. For n >1, we have 

n 

Sn{q,t) = Hit + \i], -i)=Y. r'^'-h^'"'^'"^ . 

Proof. We find it convenient to prove an equivalent factorization, namely, 

n 

eSn{q, 1/t) = JJ(i + t[i]g ~t)= J2 g^°'^('")r-^y^("') = J2 q^°'^'"h^'^'"\ 

i=l WdSn WGSn 
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Define the linear map : Z[5„] ^ Z[q,t] given by (j){w) = q^o'^Mt^'M, It is clear that 
'l + qt + qH-\ h qH) = (1 + t[i + 1], - t). It suffices to show 

0($1 ■ ■ ■ <l>„_2)0($n-l) = 0($1 ■ • • $n-2$n-l). 

Following the proof of Proposition [2] we let w = wi ■ ■ ■ Wn-in. Notice that since w„ = n, then 
for 1 < i < n, d'iwtin) = i'{w) + 1. Hence we have: 

(t){w ■ $„_i) = (t){w) + (j){wtn-ln) H h 0(u^ti„) 

= (f){w) + qt(f){w) H h q"~'^t(j){w) 

= 0(w)(i + tMg - 1) = 0H0($„_i). 

Thus, 

>l---$„_2$n-l) = 5^ W-$n-l 

\ ii)e5n,«'(n)=n 

«)SS'n,ui(n)=n 

U)£S'n,Ul(n) = 71 

)„_l)0(<l>l---<l'„_2), 

as desired. D 

Taken together, these corollaries give our ffist main result. 
Corollary 3. The pairs of statistics (inv,rl-min) and (sor, eye) are equidistrihuted over Sn: 

\ ^ inv(ui)j.rl-mm(u)) \ ^ sor(«))j.cyc(u)) 

In particular, sor is a Mahonian statistic, and rl-min is a Stirling statistic. 

We remark that there is a bijection that maps a permutation w with k cycles to a per- 
mutation w with k right-to-left minima, and thus cyc(w) = rl-min(i()). (This is a variation 
of an idea given by Stanley [HI Proposition 1.3.1].) We will illustrate the bijection with an 
example. First, we write w in cycle notation, so that each cycle has its least element written 
last, and the cycles are in increasing order by least element. With w = 685942317, we write 
it as w = (6281) (54973). We simply remove parentheses to achieve the one-line notation for 
w: 

w = 628154973. 

To reverse the process, simply insert ")" to the right of each right-to- left minimum, and put 
"(" at the far left and following any internal right parentheses. One can check with this 
example that cyc(w) = 2 = rl-min(w). 

While the map w ^-^ w shows that eye and rl-min are equidistributed, it does not carry 
sot{w) to inv(w) (in the example above sor(w7) = 21 and inv(w) = 17), and so it does not give 
a bijective proof of Corollary [31 It would be interesting to find a bijective proof of Corollary 
[3], or to find a simple bijection that carries inv to sor. While one can define such a map 
inductively via our factorizations, a more "natural" description would be better. 



the sorting index 
3. Type B 



The hyperoctahedral group Bn is the set of permutations of {1, . . . ,n, 1, . . . ,n} (where 
i = —i) that are centrally symmetric, i.e., elements 

W = Wfi- ■ ■ WiWi ■ ■ -Wn 

for which w{—i) = —w{i). Thus w is determined by the word w = Wi- ■ ■ Wn- That is, elements 
of Bn are signed permutations. These may be generated by the following transpositions: 

T^ = {(U) ■.l<t<J<n}U {(Jj) : 1 < 2 < J < n}, 

where, in order to maintain symmetry, the transposition (ij) means to swap both i with j 
and i with j (provided i 7^ j). The simple transpositions we denote 

S^ = {(11)} U{{ii + l):l<i<n-l}, 

and these form a minimal generating set for 5„. As before, we abbreviate the transpositions 
by tij = (ij) and Si = {ii + 1), with sq = (II). 

3.1. Mahonian statistics. For a signed permutation w G Bn, the minimal number of terms 
in S^ needed to express w is called its length, Ib{w)- As with permutations, the length of 
an element in Bn (as a reflection group) is equal to its inversion number: isiw) = inv b{w), 
which we now define. Let N{w) denote the number of bars in Wi- ■ -Wn, and define the type 
Bn inversion number as follows: 

invBiu)) = \{l < i < j < n : w{i) > w{j)}\ + \{1 < i < j < n : —w(i) > w{j)}\ + N{w). 

For example, inv^ (24513) = (3 + 2 + 1) + (2 + 2 + 1) + 3 = 14. By analogy with the type A 
case, we call any statistic with the same distribution as length a Mahonian statistic. 

We will define a "type B" straight selection sort algorithm below. The algorithm achieves 
a unique factorization as a product of signed transpositions: 

W = ti-^j-^ ■ ■ -ti^j^, 

with < ji < ■ ■ ■ < jfc. The type Bn sorting index, sotb{w), is defined to be 

k 



soiBiw) = ^ js -is- x{is < 0). 



s=l 



For example, ii w = 24513, we have 

31542 24513 ^ 51342 24315 ^ 54312 21345 ^ 54312 21345 ^ 54321 12345 

and so: 

W = ti2t33t24t35 sotb{w) = (2 - 1) + (3 - (-3) - 1) + (4 - (-2) - 1) + (5 - 3) = 13. 

As before, the sorting index in some sense keeps track of the distances traveled by the elements 
being sorted. We will show that the type B sorting index is Mahonian over Bn- 
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3.2. Stirling statistics. The minimal number of transpositions in T^ needed to express w 
is the reflection length, £'q{w). We know of no simple way to compute the reflection length 
of an element of Bn (apart from sorting). It would be nice to find a formula for reflection 
length involving, say, the cycle structure of w G i?„ (perhaps viewed as an element of S'2„). 
Nevertheless, the coefficients of the polynomial 



J2 t'^(-) = (1 + t)(i + 3t) . . . (1 + (2n - l)t) = J2 c(^, k)f' 



j.n—k 
w€B„ k=l 



are known as the "type B" Stirling numbers of the first kind. 
Define another statistic, 

nmin(w) = \{i : Wi > \wj\ for some j > i}\ + N{w). 

For example, ii w = 34187625, then nmin(t(;) =4 + 2 = 6, while one can check i^iw) = 7. 
We will show nmin is equidistributed with reflection length. 

3.3. Factorizations of the diagonal sum. Just as we can generate all of Sn inductively by 
inserting the letter n into a permutation of n — 1 in all possible positions, so we can generate 
Bn from Bn-i by inserting ra or ra in all possible ways. Similarly to Section 12. 3[ define 
elements \l'i of the group algebra of Bn as follows: \E'i = 1 + sq, ^1^2 = 1 + si + siSq + siSqSi = 
1 + si ■ \E'i + siSqSi, and in general for z > 1 define \E'i = 1 + Si-i ■ ^i_i + Sj_i ■ ■ ■ siSqSi • ■ ■ Sj-i. 

Proposition 3. We have 

w£B„ 

Proof. Clearly \l'i = J2weB ""^^ -^^^ induction, suppose \E'i ■ ■ ■ \E'„-i = J2weB _ '"^- ^^ "^^^ 
identify the elements of -B„_i with the set 

{w E Bn : w{n) = n}. 

Given such an element w = wi- ■ ■ Wn-in, the terms in \E'„ dictate the location and sign of n: 

W ■'$n = W + WSn-l + WSn-lSn-2 H h w{Sn-l " " " Si) 

+ w{Sn-l ■ ■ ■ SiSq) + w{Sn-l " " " SiSqSi) H h w{Sn-l ' ' ' SiSqSi ■ ■ ■ Sn-l) 

= Wi- ■ ■ Wn-in + Wi ■ ■ ■ Wn-2nWn-l + Wi ■ ■ ■ nWn-2Wn-l H h UWi ■ ■ ■ Wn-1 

+ nWi ■ ■ ■ Wn-l + WinW2 ■ ■ ■ Wn-l + \-wi--- Wn-in. 

Moreover, from this description it is clear that u; ■ \E'„ = f ■ \E'„ if and only ii w = v. We have 

^i---^„_i^„= Y^ W^„=^M, 

w(^Bn,w{n)=n uGBn 

as desired. D 

We will now describe how this product formula relates to signed permutation statistics. 
Corollary 4. For n > 1, we have 



Bn{q, t) := n(i + tm, - ^) = E r^^^'^t" 



inv3(«))^nmin(ui) 
1=1 w£B„ 
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As with Corollary [H this generating function for (inv^, nmin) is obtainable from [5l Theo- 
rem 1.2]. 

Proof. Define the linear map tjj : Z[Bn] -> Z[g,t] given by ^(w) = qi^^BM^nmm{w) _ j^ ^g ^^^^^ 
that ip{-^i) = {l + qt + qH-\ h q'^'^H) = (1 + t[2i]g - t). Assume for induction that 

V^(^i---^„_i)=^(^i)---^(^„_i)= Yl ^H- 

weBn-l 

It suffices to show that the following holds: 

7/^(^1 ■ ■ ■ ^„_i)v^(^„) = v^(^i ■ ■ ■ ^„_i^„). 

Following the proof of Proposition [3l we see that \l/„ has the effect of positioning n in a 
signed permutation and determining its sign. Following the characterizations of nmin and 
invs above, we have, for a signed permutation w = Wi- ■ ■ Wn-ifi: 

Ipiw ■ ^n) = -ipiWl ■ ■ ■ Wn-in) + IpiWi ■ ■ ■ Wn-2nWn-l) H h IpinWi ■ ■ ■ Wn-l) 

+ tpinWi ■ ■ ■ Wn-l) + i^iWifl ■ ■ ■ Wn-l) H h "(piwi ■ ■ ■ Wn-iu), 

= ipiw) + qttpiw) H h q'''H%l){w) 

+ q^'tiljiw) + g"+4^(w) + ■ ■ ■ + g2"-it^(^y), 
= (1 + t[2n]g - t)^H = ij{mn)i^{w). 

Thus, 

^(^l---^„_l^„) =V^ Y^ W^n 

\w£Bn,w{n)=n 

Y, Hw- ^„) 

wS:Bn,w{n)=n 

= v^(^„) Y ^H 

w£Bn,w{n)=n 
= V(^n)^(*l---^n-l), 

as desired. D 

We now present a different factorization of the sum XI^gb "^^ ^^^ $i = 1 + tn, $2 = 
l + ti2 + ti2 + ^225 and for j > 2 let ^j = 1+ Y, ^ij- 

Proposition 4. For n > 1, we have 

$l$2---*n = Y ^- 

weB„ 

Proof. Obviously the formula holds for n = 1. For induction, suppose $1 ■ • • $„_! = J2weB _ ^• 
We observe that $„ is 1 plus the sum of all transpositions involving the letter n. Thus, for 



n 
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w = wi- ■ ■ Wn-in we have 

W ■ $„ = W + Wtn-in + Wtn_2n H h Wtin + Wtf^ + W^n H h Wtfin 

= Wi- ■ ■ Wn-lTl + Wi- ■ ■ nWn-l + Wi ■ ■ ■ nWn-lWn-2 + " " " + nW2 ■ ■ ■ W„_ltf 1 

+ nW2 ■ ■ ■ Wn^lWi + Win ■ ■ ■ Wn-lW2 H h Wi ■ ■ ■ Wn-in. 

Clearly w ■ $„ = f ■ $„ if and only ii w = v, and so we have the desired result: 

w£B„,w{n)=n uig_B„ 

Next we use the factorization to obtain the statistical distribution. 
Corollary 5. We have 

weB„ 

Proof. This proof is nearly identical to previous arguments. We show that the linear map 

: Z[fi„] -^ Z[q,t] with 0(w) = g«°>-s(«>)^^i,(«;) ^^eys 

0($1 ■ ■ ■ $„_i)0(<l'„) = 0($i ■ ■ ■ <I>„_1$„). 

This follows by induction on n and the observation that $„ is all transpositions involving 
n and hence the products of transpositions generated are indeed reduced. D 

We state our desired equidistribution result as follows. 

Corollary 6. The pairs of statistics (invB,nmin) and (sorBji's) (ii"^ equidistributed over Bn: 

\ ^ mvB(,w),nmm(w) _ \ ^ sot b (w) .e'g (w) 
weB„ weBn 

In particular, sotb is Mahonian and nmin is Stirling. 

4. TYPE D 

The type D„ Coxeter group can be defined as the subgroup of -B„ (n > 4) given by elements 
with an even number of minus signs. The minimal generating set for Dn is 

S^ := {(12)} U{{ii + l):l<i<n-l}. 

We denote these simple transpositions hj Si = {ii + 1) and sj = (12). 
We will use the same notation for transpositions as in the type Bn case: 

T^ = {(U) : 1 < ^ < J < n} U {(tj) ■.l<t<j<n}, 

with tij = {ij). However, we caution that as opposed to the type B case, the transpositions t-^ 
are not refiections in D„. (Recall that a refiection in a Coxeter system {W, S) is any conjugate 
of an element of S, i.e., t is a refiection if and only if t = wsw"^ for some s E S and w G W.) 
In particular, in Dn we have tji = 1 and for 1 < i < n and w = wi- ■ ■ Wn, 

Wtji = W1W2 ■ ■ ■ Wi-iWiWi+i ■■■Wn- 

The type D sorting index will be defined in terms of a certain factorization by transposi- 
tions in T-^, but, as not all elements of T^ are refiections, it does not share the same close 
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relationship with reflection length that was seen in types A and B. Thus we consider only the 
Mahonian statistics in this case. 

4.1. Mahonian statistics. The length of an element w G -D„, denoted £0(10), is the minimal 
number of adjacent transpositions from S^ needed to express w. The type D„ inversion 
number is defined as: 

mY£){w) = \{l < i < j < n : w{i) > w{j)}\ + \{l < i < j < n : —w{i) > w{j)}\. 

For example, inv^ (32451) = (1 + 2 + 2) + (3 + 1 + 1 + 1) = 11. We have ioiw) = invoiw) 
for w G Dn- 

Although it is not necessarily a product of reflections, there is nonetheless a unique factor- 
ization 

"W = ti^j^ ■ ■ ■ ti^j^ , 

with 1 < ji < ■ ■ ■ < jfc, and the type Dn sorting index, sotc^w), is defined to be 

k 

sorD(w) = ^ js - is - 2 ■ x{is < 0). 

s=l 

The sorting index of type D differs from the type B version in two key ways. First, we use 
only the transpositions (ij) with j > 2 (in particular (11) is not used), and second, when i 
is negative the distance between i and j is j — i — 2. This is intuitively nice when we think 
of elements of Dn not as symmetric chains, but as symmetric posets with a "fork" in the 
middle: 

Wn-- -102 ^_ W2---Wn- 

For example, consider the following sorting of the element w = 32451 G -D5. We have 
1542 I 2451 ^ 5142 l 24l5 ^ 5412 l 2l45 ^ 5432 \ 2345 

o o o 1 

and so soiDiw) = (5 - (-4) - 2) + (4 - 3) + (3 - (-1) - 2) = 10. 

4.2. Factorizations of the diagonal sum. As with ordinary and signed permutations, 
there are at least two natural ways to generate elements of Dn given the elements of Dn-i- 
For the first of these, define ^1 = 1 + si + sj + sisi, and for i >2, define \E'j = 1 + Sj\E'j_i + 
Si- ■ ■ S2S1S1S2 ■ ■ ■ Sj. We have the following factorization of the diagonal sum. 

Proposition 5. For n > A, we have 

(3) ^1^2---^n-l= Yl ^- 

w€Dn 

Proof. One can verify (preferably with computer assistance) that \E'i\E'2\E'3 = J2weD4'^- ^'^^ 
induction, we simply examine the effect that ^n-i has on an element w = Wi- ■ ■ Wn-i G -Dn-i- 
We have: 

W ■ \E'„_i = W + WSn-l -\ h WSn-1 ■ ■ ■ S2 + w{Sn-l ' " " S2S1) + w{Sn-l " " " S2Si)w 

+ w{Sn-l ■ ■ ■ S2S1S1) H h w{Sn-l " " " S2S1S1S2 " " " S„_l) 

= Wi- ■ ■ Wn-in + Wi • ■ ■ Wn-2nWn-l H h WiU ■ ■ ■ Wn-l + UWi ■ ■ ■ Wn-l 

+ nwi ■ ■ ■ Wn~i + Win ■ ■ ■ Wn^i H \-wi--- Wn^in. 
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The result now follows as in the proof of Proposition [3l D 

Let ^ : Z[Dn] -^ Z[g] by i){w) = q^^i^^'"^ so that ^(^i) = (1 + g + ■ ■ ■ + q'-^ + 2q' + q'+^ + 
■ ■ ■ + q^^) = (1 + q^)[i + V\q. By applying ip to both sides of (I3l), we have the following. (The 
second equality follows from the fact that [i\q{l + g*) = [2z]g.) 

Corollary 7. We have 

n—l n—1 

Dn{q) := Y. ^'""^'"^ = 11(1 + q% + 1], = [n], ■ \[[2i\. 

We omit the proof as it closely follows the related argument for type B. 
We now give a factorization analogous to Propositions [2] and HI Let $j = 1 + X] i>i>j '^ij be 
as defined in Proposition HI 

Proposition 6. For n > 4, we have 

(4) $2$3 ■ ■ ■ $n = Y w. 

Proof. One can verify the claim when n = 4. The general case follows by induction as with the 
earlier proofs. For consistency, we describe the effect of $„ on an element w = Wi- ■ ■ Wn-in. 
We have: 

W ■^n = W + Wtn-ln + Wtn~2n H h Wtln + W^In + W^n H h Wtnn 

= Wi- ■ ■ Wn-lTl + Wi- ■ ■ nWn-l + Wi ■ ■ ■ nWn-lWn-2 + " " " + nW2 " " " Wn-lWi 
+ nW2 ■ ■ ■ Wn-lWi + Win ■ ■ ■ Wn-lW2 H \-wi--- Wn-in, 

from which the result follows. D 

Define (f) : Z[£)„] -^ Z[q] with (j){w) = q^°'D('"l By construction, 0($i) = {1 + q + ■ ■ ■ q^-^ + 
2g,i-i _|_ g« _|_ . . . _|_ ^22-2-1 _ j']^ _|_ g«-i)[^]^. Applying (^ to (jl]), we have the following, for which 
we again omit the proof. 

Corollary 8. For n > A, we have 

n—l n—l 

Dn{q) = Y. ^'""^"^ = n^i + ^')[^ + 1]« = N, ■ n[2' 

WdDn *=1 «=1 

From Corollaries [8] and [7] we have shown that sor/j is Mahonian. 
Corollary 9. The statistics inv/j and sor/j are equidistrihuted over Dn: 

weDn weDn 

That is, sotd is Mahonian. 



i\q- 
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w 


^1) ■ ■ ■ ) (^n 


An 


1,2,3. ..,n 




Bn 


l,3,5...,2n-3,2n- 


- 1 


Dn 


1,3,5 . . . ,2n — 3,n - 


1 



Table 2. Exponents for the Coxeter groups of types An, Bn, and Dn- 



5. Finite Coxeter groups 

Given a Coxeter system {W, S) and an element w G W, we define the length, i{w), to be 
the minimal number of terms needed to express w as a product of elements in the set 5*. The 
set of all reflections of {W, S) is the set T := {wsw~^ : w E W, s E S} . The reflection length, 
i'{w), is the minimal number of terms needed to express w as a product of elements in the 
set T. We have the following classical results on the distribution of these statistics for finite 
Coxeter groups W. See [101, Sections 3.9 and 3.15]. 



Theorem 5.1. For a finite Coxeter group W , 
(a) (Solomon) 






e.{w) 



\{[^^ + ^],. 



and 
(b) (Shepard-Todd) 



$:/(-) =n(i+e.t). 



wew 



i=l 



where the Ci are the exponents ofW. 



Thus, both the length and refiection length generating functions have a common refinement, 
defined as follows: 



W{q,t):=l[{l+t[e, + l],-t), 



and implicitly there are statistics m and h such that: 



W{q,t)=J2Q'^'"^t 



h{w),i'{w) 



wew 

weW 



£(w)±m{w) 



For W = An and W = Bn we have given explicit descriptions for both /o and m. It would 
be nice to have a type-independent description of these statistics. Notice that the ith factors 
Propositions [H [21 [31 and [H each have Cj + 1 terms. This is not the case for Propositions [S] and 
[HI In fact, one can show for D4 that such a factorization (at least one that is well-behaved 
with respect to length or refiection length) does not exist. 



We use h to suggest height, as used in the theory of root systems. Each refiection t (in a Weyl group) 
corresponds to a unique positive root /?. As we have defined things, in both An and i?„, ft.(/3) = sor(i), and 
if w = ti • • • ifc is the factorization produced by sorting, then /i(/3i) + • • • + h(/3^.) = sor(w). 
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6. Final remarks 

Upon completion of this work, the author was made aware of independent work of Wilson 
[T5[ Sec. 2.2], in which the type A version of the sorting index is described. Wilson has 
explored the sorting index further in a recent paper y^ . This paper establishes in particular 
that the sorting index is not trivially equivalent to many well-known Mahonian statistics. 
Nonetheless, work of Galovich and White |9] gives a recursive method for constructing a 
bijection f : Sn ^ Sn such that sor(w) to inv(/(w)). This follows because the sorting index 
is what Galovich and White call a "splittable Mahonian" statistic. 

Another connection to the type A sorting index appears in recent work of Foata and Han 
[B]. In particular, their "B-code" (6i, ■ ■ ■ ,bn) oi w G Sn is given by bj^ = js — is for each jg 
that appears appears in the factorization w = ti^j^ ■ ■ ■ ti^j^ of Section 12.11 {hj = otherwise). 
Moreover, the final paragraph of p, Section 6] describes a related statistic "env" which gives 
rise to an equidistribution result similar to Corollary [31 

It is perhaps unsurprising that several researchers have independently discovered connec- 
tions with the type A sorting index, as "straight selection sort" is such a natural operation. 

The author would like to thank Dennis White and Mark Wilson for helpful comments and 
Einar Steingrimsson for pointing out the connection with Wilson's work. 
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